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PSYCHOLOGICAL PRINCIPLES INVOLVED WITH RULE GENERALITY 
(DEGREE OF NONSPECIFICITY) AND PERFORMANCE CONSISTENCY IN 
MATHEMATICAL PRESENTATIONS WERE STUDIED. SPECIFICALLY , THE 
PURPOSES WERE Cl} TO DETERMINE IF TEST BEHAVIOR CONFORMS TO 
THE SCOPE OF A VERBALLY ADMINISTERED TEST RULE, (2) TO 
EXPLORE THE INTERPRETAB IL I TY OF VERBAL TEST RULES, AND (3) TO 
DETERMINE WHETHER “WI THIN SCOPE" USE OF A RULE IMPLIES 
"BEYOND SCOPE" USE WHEN NO INFORMATION IS GIVEN AS TO WHEN A 
RULE IS AND IS NOT APPROPRIATE. TWO EXPERIMENTS WERE 
CONDUCTED. IN EXPERIMENT 1, 65 COLLEGE STUDENTS PARTICIPATED 
IN A GAME OF NUMBERS, USING 1 OF 3 RULES (OF VARYING 
GENERALITY) FOR WINNING THE GAME. IN EXPERIMENT 2, THE 
VARIABLES WERE RULE GENERALITY (3 LEVELS) AND EXAMPLE 
(GIVEN-NOT GIVEN). THE MATERIALS, BASED ON ARITHMETIC SERIES, 
WERE PRESENTED TO 1*4 JUNIOR HIGH SCHOOL STUDENTS . EACH 
STUDENT WAS TESTED ON THREE PROBLEMS (!) WITHIN THE SCOPE OF 
THREE SEPARATE RULES, (2) WITHIN THE SCOPE OF THE TWO MORE 
GENERAL RULES. AND (3) ONLY WITHIN THE SCOPE OF THE MOST 
GENERAL RULE. FINDINGS WERE THAT (1) EACH GROUP’S PERFORMANCE 
WAS AT ESSENTIALLY THE SAME LEVEL ON THE "WITHIN SCOPE" 
PROBLEMS, (2) THE RULE TAUGHT FOR ONE PROBLEM TENDED YO BE 
USED BY THE SUBJECTS ON SUCCEEDING PROBLEMS WHETHER 
APPROPRIATE OR NOT, AND 13) THE "MOST SPECIFIC" RULE WAS 
BETTER LEARNED THAN OTHERS. PRACTICAL IMPLICATIONS FOR 
TESTING AND THEORETICAL QUESTIONS WERE DISCUSSED. (RS) 
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ABSTRACT 

Rule Generality and Consistency in Mathematics Learning 

Joseph ii. Scandura 
University of Pennsylvania 

Ernest Woodward and Frank Lee 
Florida State University 

Two experiments were conducted* In experiment one* 
51 college S3 were taught one of three rules, of varying 
generality, for winning the game of NX. 4. Two additional 
groups of 17 Ss each served as controls* In experiment 
two, the variables were rale generality (3 levels) and 
example (given— not given) * The materials, based on 
arithmetic series, were presented to 114 junior high 
school 3s. All Ss were tested on three problems, the 
first within the scope of each rule, the second within 
the scope of the two more general rules, and the third 
only within the scope of the most general rule. 

The results generally justify the categorization 
of verbally presented rules as to generality* There was 
positive transfer to an outside scope problem in only 
one case and each group's performance was at essentially 
the same level on the within scope problems. In experi- 
ment one, the most specific rule was better learned than 
the others j a similar, but weaker, effect was noted in 
experiment two. 
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A third facet of the study dealt 
with response consistency* Except for one case where 
the effect was rather directly attributable to prior 
learning, those Ss who used the rule taught on one 
problem tended also to use it on succeeding problems 
whether or not the rule was appropriate. 

Both practical implications for testing and 
theoretical questions were discussed. 
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Rule Generality and Consistency in Mathematics Learning! 

Joseph i t • Scandura 
university of Pennsylvania 

Ernest Woodward and Frank Lee 
Florida State University 



In many instructional situations, the question 
often arises as to hew general the presentation of 
material ought to be. Some proponents emphasize that 
the more general a principle the more useful it will 
be; others# that the more specific the principle, the 
better the learning. There is a real need to better 
understand the psychological principles involved but 
previous s tulles dealing with rule (or principle) 
learning (e.g. , Craig, 1956; Gagne and Brown, 1961; 
Haselrud and Meyers, 195ci? Kersh, 1956, 1962; Kittle, 
1957;^Wittrock, 1963), have dealt only indirectly with 
this question. 

This study represents a first attempt to provide a 
rigorous definition of principle (or rule) generality 
and to contrast the logically determined behavioral 
implications of this definition with the results actually 
obtained. The definition of generality used is a natural 
extension of a definition introduced earlier (Scandura, 



1 This research was conducted at the Florida State univ- 
ersity where the senior autior was formerly located and 
was supported by the U.S. Office of Education. 

Although a legitimate distinction may be made between 
rules and principles, the distinction is fine and was 
n^^ecogniiiSnxntrr after the study was completed. The 
terms have been used synonymously throughout the paper 
except in the concluding section where the distinction 
is outlined. 
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1966a) as part of a new scientific Set-Function Language 
(SFL) for formulating research questions on meaningful 
learning. The denotation (i.e. , observable aspect) of 
the principle, which is the basic behavior unit (as 
opposed to the association) in the SFL, is defined as a 
function — that is, as a set of ordered stimulus-response 
pairs, f * I (Si, %) ji = 1, n, ...}, in which each 

stimulus is paired with a single response. When viewed 
in terms of sets, principles are naturally orderable as 
to generality; one set (principle) may be said to be 
more general tha n another if it includes all instances 
(S-R pairs) of the latter plus some of its own . 

More particularly, concern here was with principle 
statements of the form, "If A, then B" (see Gagne, 1965? 
Scandura, 1966a, 19663} , — e.g., given some numerical 
series, the sum may be determined by squaring the 
number of terms in the series. The associated te*>t 
stimuli (e.g. , number series) and responses (e.g., sums) 
were used to test for the acquisition of stated 
principles. 

In accordance with the above definition, the state- 
ment of a highly general principle was expected to 
induce appropriate performance on a wide variety of 
tasks. At the same time, it was felt that ease of apply 
ing a presented principle might vary directly with its 
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specificity. In snort, tna generality of a principle 
is a structure variable, one whose effects on inter- 
pretability and transfer we wanted to cate mine. 

Principle generality was not viewed simply as an 
empirical variable. To the contrary, we feel, as do 
Wittrock and Keislar*, that principle generality may be 
a fundamental variable underlying the results of some 
of the rule related studies cited above. For illustra- 
tive purposes, consider the f&ttrocfe (1963) study. It 
is recent and well designed, and so provides an excellent 
case in point. The independent variables in Wittrock' s 
study were (1) rule (given-not given), (2) answer 
(given-not given). Tne treatments involved presenting 
(or not presenting) a rule along with a problem to which 
the rule applied with (or without) the answer. For our' 
purposes, it will suffice to consider the resultant 
performance on tne original problem (s) and on new problems 
to which the rules applied. In view of the proposed 
definition of principle generality, the answer given 
groups were effectively presented with a very restrictive 
principle— a principle applicable to exactly one stimulus. 
Tne rule given groups ware shown a more widely applicable 
rule statement, When looked at in this way it is not at 
all surprising that (1) the answer given groups did as 
well as the rule given groups on the learning test, (2) 
the rule given groups did better on new problems to 



♦Personal communication 
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which the rule was applicable. Furthermore , the 
relatively poor performance of the rule and answer given 
group, as compared to the rule given group, on the 
latter measure, is suggestive of the relative difficulty 
of learning principles of different generality. The 
obtained results could be explained by postulating that 
the rule ana answer given Ss took the path of least 
resistance and simply remembered the answer while 
ignoring the rule. 

Of course, tne results can be interpreted equally 
well in terns of the variables explicitly manipulated 
in the Wittrock (1^63) stuay • In what sense is rule 
generality more basic taan the rule and answer variables? 



The answer lies in what ootn we and Wittrock and Kaislar* 
believe to be the greater explanatory power of what might 
be called generality laws (hypotheses) — e.g., a rule of 
lesser generality is easier to learn and apply than one 
of greater generality — as compared with those laws (results) 
obtained earlier by Wittrock— e.g. , giving rules is better 
than not giving rules •••• The generality laws can be used 
to explain these results, but the relationships found 
(i.e., the results) cannot easily be used to explain the 
proposed generality laws . It is to Wittrock* s credit 
that he emphasised the phenotypic nature of the rule and 
answer variables and later helped to explicate one form of 
the generality hypothesis (based on an 3~±< mediation argument) ... 

Another facet of this research concerns the 
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♦Personal cormnun i c a t ion . In reacting to the manuscript 
on which this article is cased, Wittrock called our 
attention to another form of the generalization hypothesis. 
In two recent studies (Wittroc k, Keislar, & Stern, 

Verbal Cues in Concept Identification, Jo urnal cf 
educational Psychology , 1964, 55 , 195-2 0 6 ; wittrock « 
keislar, Verbal Cues in the transfer of Concepts- 
Journal of Educational P3ychologY » 1 9 65 . 56 , 1 6 - 21 . ) , 

Ss were prei r aini a on a hierarchically arranged associa- 
tive structure, composed of word or pictorial stimuli, 
ana then, during learning, were given cues at ore level 
in tne hierarchy. These cues wers presumed to facilitate 
discovery of the concepts and/or rules underlying 
appropriate behavior on the learning tasks. Tbssa 
authors, 

"hypothesised that in a problem-solving test 
where there was a low probability of success 
without cues, transfer would o& related to tne 
type of cue usea earlier during instruction. 

The class cue should produce the greatest 
transfer to new instances of the same class; 
the specific cue should produce the greatest 
initial learning; and the general cue should 
produce the greatest remote transfer or 
transfer to new concepts (V'ittrock & keislar, 

1955, 16) . '• 

Support was obtained for the first two hypotheses, 
but not the last. Since the prior training was common 
to all Ss, the cues presumably acted as much to induce 
an appropriate responding set as to modify "what was 
learned." To the extent, then, that word and pictorial 
cues, pre training on hierarchically arranged associativa 
structures, and einstellung effects or learning by 
discovery, can be equated with rule or principle 
statements, the prior learning had by the college Ss 
used in this study, and what is learned by exposition, 
respectively, the hypotheses proposed by Uittrock and 
Keislar and those proposed here are very similar. 

nonetheless, the present hypotheses were derived 
in a manner quite distinct from the way in which 
Wittrock and Keislar derived theirs. For one thing, 
transferability was equated with the logically determined 
scope of principles— the inclusiveness of its denotative 
set* of instances (ordered S-R pairs) . The interp ratabil- 
ity hypothesis, however, was originally based simply on 
intuition. It was only after a post hoc analysis of the 
experimental results led to a more complete formulation 
of the SFL that a formal rationale was proposed. Wittrock 
and keislar based their hypotheses on S-R mediation theory. 
In addition to being based on the principle, rather than 
the association, the SFL seems to be leading to quite a 
different set of theoretical assumptions than those 
underlying S-R theories. In particular, (continuous) 



generalization gradients, baseu on response strength 
(see footnote in Discussion Section) , do not appear 
necessary in SFL formulations, 

V — Further discussion is beyond the scope of this 



paper. Some related issues nave been dealt wit- 
more fully elsovnisre (Scandura, 195 Or, I9£6d v n 
theoretical wo::%. is still in progress » 
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consistency with which a presented principle (or concept) 
is applied, in an earlier study2 , Greeno and Scandura 
(1966) found, in a verbal concept learning situation, 
that after learning a common response to one or more 
stimulus exemplars of a concept, S either gave the 
correct response the first time he saw a transfer stimulus 
(i.e., a new exemplar of the concept) or the transfer 
item was learned at the same rate as its paired control 
in a (transfer) paired-associate list. Scandura (1966a, 
1966c, 1966d) later reasoned that if transfer obtains 
on trial one, if at all, tnen responses to additional 
transfer items, under appropriate conditions, should be 
contingent on the response given to the first transfer 
stimulus. The results of a pilot study were revealing 
(Scandura, 1966c). In 47 of 52 cases, in which the 
first test response indicated that a concept had been 
acquired, the concept also provided the basis for 
responding to a second test (i.e., transfer) stimulus. 
Similar pilot results obtained when the test responses 
were based on principles of the form, "If the stimulus 
object is large, then the response is the name of its 

color" (Scandura, 1966a, 1966d) . 

The primary purpose of this research was to deter- 
mine whether test behavior conforms to the logically 

2 Conducted during the summer of 196 <&• 



determined scope of a verbally stated, principle. Assum- 
ing no a priori knowledge of related principles , appropri- 
ate responding is to be expected only within the scope 
of the principle. However, the«*e sould be no systematic 
within scope differences— all stimuli within the scope 
of a principle should be of approximately the same 
difficulty. A secondary purpose of the study was to 
explore the question of interpretability. When and why 
do verbally stated principles differ in ease of learning 
as determined by performance on within scope items? 
Originally, it was thought that generality itself might 
be the sole crucial factor. The final purpose of this 
research was to obtain further data on Scandura's (1966a, 
1966c, 1966d) response consistency hypothesis in a more 
complex situation. Does within scope use of a rule imply 
beyond scope use when no information is given as to when 

a rule is and is not appropriate? 

To obtain evidence on these points two experiments 

were conducted concurrently, one with college Ss and the 
other with junior high school S3. Mathematical materials 



were used in both experiments. 
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EXPERIMENT ONE 
Method 

Material and Subjects , The material consisted of a 
variant of the number game, "NIM H (Banks, 1964, 55-58) • 

In the game, two players alternately select numbers 
from a specified set of consecutive integers (including 
1) and keep a running sum. The winner is the one who 
picks the last number in a series having a predetermined 
sum. If this sum is 31 and the set consists of the 
integers 1-6, the players select numbers from 1-6 until 
the cumulative sum is either 31 or above (in which case 
no one wins). 

Each game of HIM can be characterized by two 
integers, an ordered pair (n, m) where n is the largest 
integer in the selection set and m is the predetermined 
sum. 

Rules are available by which the person making the 
first selection can always win. Some of these rules 
are particular to specific games whereas others are 
more general. The most specific (S) rule referred only 
to (6, 31) games. It, was stated: 

“There is a pattern to the game which will enable 
you to win whenever you are allowed to make the first, 
selection. You must, however, make an appropriate first 
selection and then proceed in a precise manner. In 
order to win the game you should make 3 your first 
selection. Then you should make selections so that the 
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suias corresponding to your selections differ by 7* u 
The rule of intermediate (SG) generality referred to 
all games of the form (b, m) and was stated: 

“...In order to win the game, the appropriate 
first selection is determined by dividing the desired 
sum by 7. The remainder of this division is precisely 
the selection which should be made first. . • • " 

The most general (G) rule referred to games of the form 
(n, m) and was stated: 

"... In order to win the game the appropriate first 
selection is determined by adding one to the largest 
number in the set from which the selections must come 
and dividing the desired sum by this result. The 
remainder of this division is precisely the selection 
that should foe made first. Then you should make 
selections so that the sums corresponding to your 
selections differ by one greater than the largest 
number in the set from which the selections must come. 55 

All of the materials were reproduced by mimeograph 
and were combined into four 8 1/2“ x 11“ booklets; 
introduction, treatment (i.e., rule), test material, 
and answer sheet. The introductory booklet contained 
six pages. Page 1 simply indicated that the experimental 
results would be made available to the Ss and asked that 
they not divulge information about the experiment to 
others who might be participating. The nature of the 
(6, 31) game was explained and an example given on page 
2. Pages 3 and 5 consisted of two different (6, 31) 
games and required S to compute the running sum in each 
in accordance with a specified sequence of selections. 
This was done to ensure that the Ss knew the objective 
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of and now to play the game, Knowledge of results on 
these practice games was given on pages 4 and 6. 

Nothing was said about tue game winning procedures! but 
it was mentioned that there are many variations of HIM. 



Three included one of the game winning rules and a 



other two booklets served as controls. The C treatment 
booklet consisted of a short topic on divisibility with 

second page. Booklet 
>ic and the (6, 31) 
running sums were 3, 
ise numbers in italics 
ical winner. By 
possible to win any 



seven pages, the first 
iook let, S was told to 
it and then turn to one 
laterials booklet for 
ler was scrambled for 
id. Problem one 
im two a (6, ni) game 
[n, m) game with n - 4 





There were five different treatment booklets 
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The 3s wore 85 Florida State University under- 

•<«* 

graduates enrolled in a mathematics education course for 
elementary teachers. Participation was a class require- 
ment. 

Design and Procedure. The Ss were assigned randomly to 
three treatment groups and two controls so that each 
group contained 17 Ss. Group S was given the (6, 31) 
rule and example, group SG the (6, m) rule and example, 
group G the (n, m) rule and example, groux^ E only the 
example, and group C nothing relevant. The experiment 
was run in groups of 17 or fewer Ss witn all but group 
E represented in approximately equal numbers. Group E 
was run at one sitting shortly after the other Ss were 
run to determine whether the example itself had a 

significant effect on learning. 

At the beginning of each experimental session, tne 
Ss were presented with the common instruction booklet 
and one of the five treatment booklets as indicated 
above. They were told to read the material carefully# 
After these booklets were completed, they were collected 
and S was given the test and answer booklets. The 
experiment was self -paced. Time for completion of the 
entire experiment varied between 15 and 40 minutes. 

Two binary criterion measures were used, use of 
appropriate pattern (AP) and use of the rule (UR) taught. 
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S was given credit for using tne AP if he won the game 

and employed an appropriate game winning strategy. 

Credit was given for UR regardless of whether or not the 
» 

strategy used was appropriate for winning the game in 
> uestion (e.g. , UR credit was given to the S group Ss 

i* 

for applying rule S on test game 2 and/or 3). 3 

All of the tests conducted were applied to 2 x 2 
contingency tables (with no pooling over treatment groups 
or test problems) • When the measures were independent , 
the exact Fisher-Yates test was usee'; when correlated , a 
different nonparametric test, based on % 2 t was used 
(itolemar, 1954, 358-359) . Alpha levels, for the former 
test, may be obtained directly from tables prepared for 
this purpose (Finney, 1948; Latscha, 1953). One-tailed 
tests were used in conjunction with the stated hypotheses 
with an alpha level of .05. 



Table 1 shows the number of Ss in each group who 
used the AP on problems one, two, and three. 



3 There were two exceptions. One S summed incorrectly 
once but otherwise established an appropriate pattern 
and was given credit for a successful execution. Another 
S made the first four selections appropriately, deviated 
on the fifth, but still won the game; this person was 
also credited with a success. 

Rule use was determined from the first and second test 
selections only. This was done because it was impossible 
for the Ss in groups S and SG to continue using their 
rule beyond that point xn test problem three without 
choosing a number outside the selection set. 
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Table 1 

dumber of Appropriate Patterns 



i‘J Problem One 
(b, 31 ) 



Problem Two 
(6 r 25) 



Problem Three 
(4, 22) 



Group C 
Group E 
Group S 
Group SG 
Group G 



17 



0 

3 



17 

17 

17 



5 

5 



0 

0 

0 

4 

5 



0 

1 

1 

0 

4 



The three treatment groups performed ’according to 
prediction* Thirteen of 17 Ss in group S were able to 
apply the (6, 31) rule to within scope problem one, but 
none discovered the more general (G, m) pattern and only 
one discovered pattern (n, at) • The differences between 
problem one and problem*: two and three were both highly 
reliable (p < *001)* As hypothesized, the SG 8a also 
used an AP only on those problems within the scope of 
the rule taught. Significantly more SG Ss solved problem 
one than problem three (p < *02) ; the corresponding 
problem two-problem three difference attained the .05 
level. There were five successes on problem one and four 
on problem two but none on problem three. In addition, 
three of the E Ss did use the game winning (6, 33) 
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pattern on problem one after having seen it used on the 
(6, 31) example but none of the small differences in 
performance on the three test problems was significant 
in either of the control groups (i.e., C and E ) . 

Equally important, there was essentially no differ- 
ence in within scope performance. Of tne five SG Ss who 
used an AP on problem one, four did so on problem two. 

The same five G Ss used an AP on within scope problems 
one and two? only one of these Ss failed to use an AP on 
problem three. Even the two minor deviations noted 
could conceivably have been classified as AP. 

Table 1 also provides a basis for comparing differ- 
ent treatment groups as to ease of learning. Again, 2x2 
contingency tables were used with groups and success- 



failure being the dimensions • Cell entries were the 



number of Ss in each category on a given problem. 

Prior to conducting the experiment, it was con jectur 
ed that performance may be enhanced most by stating a 
rule in as specific a form as possible so long as the 
criterion is within the scope of the rule. This general 
hypothesis leads to the following predictions: (1) 

problem one, S > SG > G, (2) problem two, S < SG > G, 

and (3) problem three, S * SG < G. 

The results only partially confirmed these expecta 

tions. On problem one, group S performed better than 
groups SG and G (p < .005 in both cases) , but groups St 
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and G performed at essentially the same level* On problem 
two, group SG performed better than group S (p < .05) ? 
but again, groups SG and G did not differ appreciably. 

On problem three, there was essentially no S-SG differ- 
ence but the G-SG difference was in the expected direction 
(p < .05). Representing nonsignificant differences by 
equal signs, these results may be summarized s (1) problem 
one, S > SG * G, (2) problem two, S < SG = G, and (3) 
problem three, S « SG < G. 

Consistency was based on the UR measure * In each 
case, rule users and non-rule users on a given problem 
were compared as to rule use on succeeding problems. 

Table 2 shows that the rules taught were used on 
all problems to about the same degree. A more intensive 



Table 2 







Use of Rule Taught 






N 


Problem One Problem Two 
(6, 31) (6, 25) 


Problem Three 
(4, 22) 


Group S 


17 


13 9 


8 


Group SG 


17 


7 7 


5 


Group G 


17 


6 6 


6 



individual analysis indicated that, in general, rule 
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users on problem one were rule users on problems two 
and three • Non-rule users on problem one tended to be 
non-rule users on the remaining problems. There were 
four Ss in group S who used the rule taught on problem 
one, but not on problem two; there was one who used the 
rule on problem two, but not on problem three. In group 
SG, the corresponding numbers were zero and two; in 
group G, they were zero arid zero. In all, there was a 
total of five cases in which non-rule users later used 
the rule taught. Of these, three were Ss in group S who, 
for some unknown reason, failed to use the rule on 
problem two but did so on problem three. 

In group S, significantly more rule users on problem 
one were rule users on problem two than was the case with 
non-rule users (p < .02). The same relationship held for 
problems two and three (p < .04} . The corresponding 
significance levels, in group SG, were beyond .001 and 
•01 and, in group G, were beyond .001 and .001, 
respectively. 

Discussion 

These results certainly provide strong support for 
our original hypotheses: Cl) performance on within-scope 

problems did not differ appreciably, even though the 
common example was more similar to problem one than the 
others, and successful problem solving was limited almost 



